Principal components of dark energy with SNLS supernovae: 
the effects of systematic errors 



Eduardo J. Ruiz|j Daniel L. Shafer[J and Dragan Hutereirl 
Department of Physics, University of Michigan, 450 Church St, Ann Arbor, MI 48109-1040 

Alexander Conlejj^] 

Center for Astrophysics and Space Astronomy, University of Colorado, 389 UCB, Boulder, CO 80309-0389 

We study the effects of current systematic errors in Type la supernova (SN la) measurements 
on dark energy (DE) constraints using current data from the Supernova Legacy Survey (SNLS). 
We consider how SN systematic errors affect constraints from combined SN la, baryon acoustic 
oscillations (BAO), and cosmic microwave background (CMB) data, given that SNe la still provide 
the strongest constraints on DE but are arguably subject to more significant systematics than the 
latter two probes. We focus our attention on the temporal evolution of DE described in terms of 
principal components (PCs) of the equation of state, though we examine a few of the more common, 
simpler parametrizations as well. We find that the SN la systematics degrade the total generalized 
figure of merit (FoM), which characterizes constraints in multi-dimensional DE parameter space, by 
a factor of two to three. Nevertheless, overall constraints obtained on more than five PCs are very 
good even with current data and systematics. We further show that current constraints are robust 
to allowing for the finite detection significance of the BAO feature in galaxy surveys. 



I. INTRODUCTION 

Since the discovery of the accelerating universe in the 
late 1990s [TJ |2J, a tremendous amount of effort has 
been devoted to improving measurements of dark energy 
(DE) parameters. As constraints on these parameters 
improved, controlling the systematic errors in measure- 
ments became critical for continued progress. The sys- 
tematics come in many flavors, including a multitude of 
instrumental effects and astrophysical effects. 

Type la supernovae (SNe la) were used to discover DE 
and still provide the best constraints on DE. The ad- 
vantage of SNe la relative to other cosmological probes 
is that every SN provides a distance measurement and 
therefore some information about DE. More recently, SN 
la observations have been joined by measurements of 
baryon acoustic oscillations (BAO), which provide ex- 
ceedingly accurate measurements of the angular diameter 
distance in redshift bins. Cosmic microwave background 
(CMB) anisotropics come mostly from high redshift and 
are thus not particularly effective in probing DE, but they 
do provide one measurement of the angular diameter dis- 
tance to redshift z ~ 1100 very accurately. Galaxy clus- 
ters also constrain DE usefully, while weak gravitational 
lensing is expected to become one of the most effective 
probes of DE in the near future. For recent comprehen- 
sive reviews of DE probes, see [21 0]. 

In this work, we are interested in studying the effect 
of SN la systematics on DE constraints by including the 
covariance of measurements between different SNe. The 
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covariance includes primarily systematic errors, and for 
the first time it has been quantified in depth by Conley 
et al. 5J. Including the effects of the systematic errors, 
represented by nonzero covariance, weakens the overall 
constraints on model parameters. Here we wish to ex- 
plore the effect of systematic errors for general models 
of DE described by a number of principal components 
(PCs) of the equation of state, though we first consider 
these effects for simpler, more commonly used descrip- 
tions of the DE sector. We choose to combine the SN 
la data with BAO and CMB measurements and estimate 
the effects of current systematic errors in SN la obser- 
vations. We then proceed to study another systematic 
concern that is particularly relevant for BAO: whether 
the finite significance of the detection of the BAO feature 
in various surveys, when taken into account, weakens the 
constraints imposed on DE parameters. 

While we closely follow the accounting for the SN la 
systematics from Conley et al. jS], we note that several 
other analyses have considered the effect of SN system- 
atics. However, most of these analyses only studied the 
effects of the systematic errors on the constant equation 
of state (e.g. [ME]) or included the additional parame- 
ter w a to describe the variation of the equation of state 
with time (e.g. [§]). Notable exceptions are studies by 
Davis et al. |10j and Rubin et al. |llj . which considered 
a number of specific DE models with non-standard be- 
havior, and Amanullah et al. |12j and Suzuki et al. |13j . 
which parametrized the DE density in several redshift 
bins. Here our goal is to go beyond any specific mod- 
els and study the effects of systematic errors in current 
data on DE constraints in the greatest generality pos- 
sible. While a truly model-independent description of 
the DE sector is of course impossible, a description of 
the expansion history in terms of 10 or so parameters 
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- which we adopt in this paper - comes clos^] In this 
sense, our paper complements the recent investigations 
by Mortonson et al. [H [TS] (see also [TBHIM] 1 , which 
studied constraints on very general descriptions of DE 
using (a slightly different set of) current data but with- 
out specific study of the effects of systematic errors. 

The paper is organized as follows. In Sec. [TTJ we de- 
scribe the SN la, BAO, and CMB data (and for BAO and 
CMB, the distilled observable quantities) that we use in 
our analysis. In Sec. |III[ we discuss useful parametriza- 
tions of DE and compare constraints on the DE param- 
eters with and without systematic errors included in the 
analysis. 



In Sec. IV 



we investigate the effects of the fi- 
nite detection significance of the BAO feature in galaxy 
surveys on the cosmological parameter constraints. In 
Sec. [Vj we summarize our conclusions. 



Source 


N S N 


Range in z 


Low-z 


123 


0.01 - 0.1 


SDSS 


93 


0.06 - 0.4 


SNLS 


242 


0.08 - 1.05 


HST 


14 


0.7 - 1.4 



TABLE I. Summary of SN la observations included in this 
analysis, showing the number of SNe included from each sur- 
vey and the approximate redshift ranges. 



II. DATA SETS USED 

We begin by describing the data sets used in this anal- 
ysis. We have used three probes of DE: SNe la, BAO and 
CMB anisotropies. 

A. SN la Data and Covariance 

Although SNe la are not, of course, perfect standard 
candles, it has long been known that there exist useful 
correlations between the peak apparent magnitude of a 
SN la and the stretch, or broadness, of its light curve 
(simply put, broader is brighter). The peak apparent 
magnitude is also correlated with the color of the light 
curve (bluer is brighter). We therefore model the appar- 
ent magnitude of a SN la with the equation [2"5] 

m mod = 51og 10 (J^d L ^j -a s (s-l)+P c C + M, (1) 

where di is the luminosity distance, a s is a nuisance pa- 
rameter associated with the measured stretch s of a SN 
la light curve, and (3 C is a nuisance parameter associ- 
ated with the measured color C of the light curve. The 
absolute magnitude of a SN la is contained within the 
constant magnitude offset A4, which is considered yet 
another nuisance parameter]^] 

Recent work has concentrated on estimating correla- 
tions between measurements of individual SN la magni- 
tudes. A complete covariance matrix for SNe la includes 



We do not, however, consider allowing departures from general 
relativity; doing so would further generalize the treatment. 
2 Throughout the analyses in this paper, we actually marginalize 
analytically over a model with two distinct At values, where 
a mass cut of the host galaxy dictates which Al value applies 
(here we use a mass cut of 10 10 Mq). This is meant to correct 
for host galaxy properties and is empirical in nature (see text 
and Appendix C of [5])- For simplicity, we suppress mention of 
the second At parameter. 



all identified sources of systematic error in addition to 
the intrinsic scatter and other sources of statistical error. 
The \ 2 statistic is then given by 

X 2 = Am T C- 1 Am, (2) 

where Am = m b s — m mo d(p) is the vector of magnitude 
differences between the observed magnitudes of N SNe 
la m bs and the theoretical prediction that depends on 
the set of cosmological parameters p, m mo d(p). Here C 
is the N x N covariance matrix between the SNe. Given 
a value for x 2 , we assume that the likelihood of a set 
of cosmological parameters is Gaussian, so that £(p) oc 
e^'\ 

Recently Conley et al. [5] determined covariances be- 
tween SN la measurements from the Supernova Legacy 
Survey (SNLS). The SN compilation and covariance ma- 
trix that resulted from this work will be used in this 
analysis. The SNLS compilation consists of 472 SNe la, 
approximately one half of which were detected in the 
SNLS, while the rest originated from one of three other 
sources. These four main sources are summarized in Ta- 
bleland illustrated in the Hubble diagram of Fig. [T] The 
low-redshift (Low-z) SNe actually come from a variety of 
samples as discussed in Conley et al. [5]. 

The complete covariance matrix from can be written 
most usefully as the sum of two separate parts, a diago- 
nal part consisting of typical statistical errors and an off- 
diagonal systematic part. The off-diagonal piece includes 
some correlated errors which are considered statistical in 
[5] (since they can be reduced by including more obser- 
vations), but here we disregard the distinction and group 
these errors with the actual systematic errors, which also 
lead to off-diagonal covariance elements. This simplifica- 
tion is reasonable because the correlated statistical errors 
are small compared to the (correlated) systematic errors. 
The diagonal (statistical-only) part of the covariance ma- 
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FIG. 1. Hubble diagram for the compilation of all SN la 
data used in this paper, labeling SNe from each survey sepa- 
rately and showing the (diagonal-only) magnitude uncertain- 
ties. The solid black line represents the best fit to the data. 



using the equation 

cr-E(%f)(%f 1 )( A ^) 2 ' (B) 

where the sum is over the K systematics Sk, AS^ is the 
size of each term (for example, the uncertainty in the 
zero point), and m mo( j is defined in Eq. ([lj. Then the 
full covariance matrix is simply given by 

C full = D stat + C sys^ ^ 

A plot of the full covariance matrix (constructed using 
flat w — const model best-fit values a s = 1.43 and /3 C — 
3.26) is shown in Fig. [2] 

B. BAO and CMB data 



trix can be expressed as 



nstat 2 , 2 2 , Q 1 2 i 2 

'A, = cr, 



— ■'in i ct s a s i + /3 C a C i + a int 



5(1 + Zi) 



2 , 2 
z'l ' lcnsina 



Ziil + Zi/2) log 10 

~i" a host correction u %% \ a s, Pc) 



(3) 



In the above, o mB ,t , <^s,i > &c,i , and a z ^ are the statis- 
tical uncertainties of the measured magnitude, stretch, 
color, and redshift, respectively, of the i th SN. The z term 
translates the error in redshift into error in magnitude. 
To include actual intrinsic scatter of SNe la and allow 
for any mis-estimates of photometric uncertainties, the 
quantity a m t is included, with a different value allowed 
for each sample. Also included are statistical uncertain- 
ties due to gravitational lensing and uncertainty in the 
host galaxy correction. 

The contribution to the (diagonal part of the) covari- 
ance matrix D™ bsC (a s , j3 c ) represents a combination of 
the covariance terms between magnitude, stretch, and 
color for the z th SN. It is given by 



D^ sC (a s ,(3 c ) = 2a s D^ s 



20cD%* c (4) 
2a s f3 c D s H c . 



Note that even the diagonal covariance matrix is a func- 
tion of a s and /3 C , meaning that a proper analysis involves 
varying the errors (recomputing the covariance matrix) 
any time a s and /3 C are changed. 

A similar equation can be used to construct the off- 
diagonal systematic covariance matrix, where different 
systematic terms are combined to produce submatrices 
which arc then added together with specified values for 
a s and /3 C , as above. The elements of the systematic 
covariance matrix (see [S] for more details) are calculated 



To produce the combined constraints in this paper, 
we include information from both BAO and the CMB 
in addition to the SN data. In each case, we choose for 
simplicity distilled quantities which depend only on fij/, 
57de, Qk, and a parametrized w(z). 

For BAO, we compare the theoretical prediction for 
the acoustic parameter A(z) with the measured value, 
where we define (see Eisenstein et al. [2"B] ) 



A(z) = 



"I 1/3 



r 2 (z) 



H(z) 



(7) 



We combine recent measurements of A(z) at different ef- 
fective redshifts, using data from the 6dF Galaxy Survey 
[27] . the Sloan Digital Sky Survey (SDSS) Data Release 
7 (DR7) [21], the WiggleZ survey [2! [3D], and the SDSS 
Baryon Oscillation Spectroscopic Survey (BOSS) [3Tll3"2"]. 
The measured values are summarized in Table [TT1 

A plot of the measured values and their uncertain- 
ties superimposed on an A{z) curve (Fig. |3| suggests 
that there is no significant tension between the mea- 
surements. Note that the SDSS DR7 measurements at 
z = (0.2, 0.35) are correlated with correlation coefficient 
0.337. The WiggleZ measurements are correlated with 
coefficient 0.369 for the pair z = (0.44,0.6) and coeffi- 
cient 0.438 for z = (0.6,0.73). Ignoring the relatively 
small overlap in survey volume between SDSS DR7 and 
the BOSS sample, we expect all other pairwise correla- 
tions to be zero. We compute % 2 in the usual way for 
correlated measurements, as in Eq. g. 

Nearly all of the sensitivity of the CMB to DE comes 
from the measurement of an angle at which the sound 
horizon at z ~ 1100 is observed (e.g. [33]). This measure- 
ment in turn determines the angular diameter distance to 
recombination with the physical matter quantity, Qnfh 2 , 
essentially fixed. The latter quantity is popularly known 
as the CMB shift parameter R and is defined as 



R 



(8) 
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FIG. 2. Left panel: correlation matrix obtained from the complete covariance matrix C u , sorted first by survey and then by 
redshift within each survey. Right panel: same, but using only the systematic covariance matrix C sys . In both cases we assume 
a s ~ 1.43 and j3 c = 3.26, the best-fit values for the flat w = const model. The right panel is similar to Fig. 12 from [5], but we 
repeat it here and show the full covariance (left panel) for completeness. 



Sample z cff A (z eS ) 



6dFGS 0.106 0.526 ± 0.028 



SDSS DR7 0.20 0.488 4=0.016 



SDSS DR7 0.35 0.484 4=0.016 




WiggleZ 0.44 0.474 4= 0.034 



BOSS 0.57 0.444 ±0.014 



WiggleZ 0.60 0.442 4= 0.020 



WiggleZ 0.73 0.424 4= 0.021 



TABLE II. Summary of measurements of distilled BAO pa- 
rameter A{z). We show the survey from which the measure- 
ment comes, the effective redshift of the survey (or its sub- 
sample), and the measured value Aq. 



where = 1091.3 is the redshift of decoupling as mea- 
sured by WMAP7 [34] and r(z) is the comoving distance 
to redshift z. We take the measured value of R to be 
the value determined by WMAP7, R = 1.725 ± 0.0184 
[3"4"] . We compute % 2 in the usual way, comparing this 
measured value of R with the theoretical prediction. 

Calculating the combined SN, BAO, and CMB likeli- 
hood is now a simple task. We define £ C omb °c e Xtot/ , 
where Xtot = Xsn + Xbao + Xcmb- 



FIG. 3. Measured values of A(z) and their (diagonal-only) un- 
certainties for each effective redshift. The black curve shows 
A(z) for a model that fits the data points well, and the pa- 
rameters for this model are given in the legend. 



C. Parameter constraint methodology 

We use two alternate codes to produce our constraints. 
For the basic constraints, including the constant equation 
of state of DE or the (wq, w a ) description, we use a brute- 
force search which computes likelihoods over a grid of 
values of ~ 5 parameters (listed below) . 

Alternatively, we developed a new Markov Chain 
Monte Carlo (MCMC; e.g. see [35 , 36J) code to determine 
DE parameter constraints and figures of merit (FoMs) 
for the general (~ 13 parameters) PC description. The 
MCMC procedure is based on the Metropolis-Hastings 
algorithm [37l [38]. From the likelihood £(x|0) of the 
data x given each proposed parameter set 9, Bayes' The- 
orem tells us that the posterior probability distribution 
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of the parameter set given the data is 



(9) 



where V{6) is the prior probability density. The MCMC 
algorithm generates random draws from the posterior 
distribution. We test convergence of the samples to 
a stationary distribution that approximates "P(#|x) by 
applying a conservative Gelman-Rubin criterion |39j of 
R — 1 < 0.03 across a minimum of four chains for each 
model class. We use the getdist routine of the Cos- 
moMC code [301 HI] to process the resulting chains; 
getdist bins the chains and then smoothes the binned 
distribution of counts by convolution with a multidimen- 
sional Gaussian kernel. 

We verified that the two codes give results that are 
in excellent agreement in several relevant cases, e.g. con- 
straints in the Q,m~w or w^-w a plane. 



III. RESULTS: EFFECTS OF THE 
SYSTEMATICS 

A. Preliminaries 

Before beginning our discussion of systematics, we 
briefly consider the vanilla ACDM cosmology, where 
w = — 1. The cosmological parameters describing the 
expansion rate are matter and cosmological constant den- 
sities relative to critical, CIm and £Ia- Including the nui- 
sance parameters, the total parameter set is 



Pi e {0 M ,fi A ,M,a s ,yS c }. 



(10) 



We combine SN constraints with BAO and CMB con- 
straints and marginalize over the other parameters to 
map the likelihood of f^A- We find a mean value £7 a = 
0.724 ± 0.0114. This suggests that a universe with zero 
(or negative) cosmological constant is ruled out at ap- 
proximately 64-er! Amusingly, using the brute-force like- 
lihood search that includes the positive and negative val- 
ues of f^A, we find that the combined data give a re- 
markably low likelihood of zero or negative vacuum en- 
ergy, even allowing for nonzero curvature: P(£Ia < 0) ~ 
10 . Of course, in reality, the evidence for DE is not 
nearly this convincing, since the likelihood in the space 
of cosmological observables is certainly not expected to 
be Gaussian this far away from the peak and thus would 
not be described by £ C omb ^ e~ Xtot / 2 (we discuss a re- 



lated issue in Sec. IV I. Nonetheless, it is impressive how 



strong the evidence for DE is with current data. 

We now discuss how one goes beyond ACDM cosmol- 
ogy by parametrizing the DE equation of state. 

Previous work on the effect of systematics, such as [5], 
considered the DE sector parametrized by its energy den- 
sity relative to critical, SIde, and a constant equation of 
state w. Here, we are particularly interested in extend- 
ing the DE sector to allow for a time- varying equation of 



state. We make two alternative choices in addition to the 
constant equation of state so that the three parametriza- 
tions we consider are: 

1. Constant equation of state, w — constant; 

2. Equation of state described with wq and w a [42], 
so that w(a) = w + w a (l — a); 

3. Equation of state described by a finite number of 
principal components of w{z) [43] . 

We now describe in more detail the different 
parametrizations of DE that we consider (constant w, 
wo and w a , PCs) and then proceed to analyze the effects 
of SN systematics on parameter constraints. 



B. Constant w 

Assuming that DE can be described by an equation of 
state w that is constant in time, and assuming a flat uni- 
verse, we calculate the SN-only likelihood in the Qm~w 
plane. We marginalize over the usual nuisance parame- 
ters Ai, a s , and j5 c . 

The results for SN-only constraints on Qm and w are 
shown in Fig. |4j where we illustrate the effect of the sys- 
tematics by showing constraints from the full covariance 
matrix C fu11 on top of those which assume only the diag- 
onal statistical uncertainties D stat . The systematic un- 
certainties broaden the well-determined direction in the 
Q.M-W plane without elongating the poorly determined 
direction much. Constraints in either parameter are not 
appreciably shifted. The marginalized uncertainty for w 
is a w = 0.17 for diagonal errors only and a w — 0.20 
when systematic errors are included. Thus systematic 
errors increase the uncertainty by about 20%. 

We also seek to understand how SN systematics in- 
fluence the stretch and color parameters a s and /3 C , not 
only because these correlations are what make SNe la 
useful standard candles, but also because it is expected 
that systematics could potentially affect these correla- 
tions. In Fig. [5] we marginalize over Ai, &m-> and w 
to show constraints on the stretch and color coefficients 
a s and /3 C . Of particular interest is the color coefficient 
/3 C , which is broadly consistent with values found previ- 
ously; the systematic errors shift it slightly upwards and 
increase errors in both parameters by a modest amount. 



C. wo and w a 

We wish to understand the constraints on the redshift 
dependence of w(z), so we allow w(z) to have the form 



w(z) = Wq + W a zj (1 + z). 



(11) 



Constraints on wq and w a in a flat universe are shown in 
Fig. [6] The shaded blue contours represent constraints 
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0.1 0.2 0.3 0.4 0.5 0.6 

FIG. 4. 68.3%, 95.4%, and 99.7% likelihood constraints on 
Qm and w, assuming a constant value for w and a flat uni- 
verse. We use only SN data and marginalize over the nuisance 
parameters. We compare the case of diagonal statistical er- 
rors only (shaded blue) with the full systematic covariance 
matrix (red). 
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1 1.2 1.4 1.6 1.8 2 

FIG. 5. 68.3%, 95.4%, and 99.7% likelihood constraints on a 3 
and /3 C , assuming a constant value for w and a flat universe. 
We use only SN data and marginalize over Ai, £2m, and w. We 
compare the case of diagonal statistical errors only (shaded 
blue) with the full systematic covariance matrix (red). 



with only statistical SN errors assumed (D stat ), while the 
red contours include the full systematic SN covariance 
matrix (C fu11 ). The left panel shows SN-only constraints, 
while the right panel shows constraints when BAO and 
CMB information is also included. 

The figure of merit (FoM) for this model defined by the 
Dark Energy Task Force (DETF) [45l |46] is the inverse 
of the area of the 95.4% confidence level region Ag 5 in 
the wo-w a plane. To be precise about its normalization, 



we simply define the FoM as in Mortonson et al. [TS] as 
YoM {waWa) = (detC)- 1 / 2 w (12) 

^95 

The approximate equality in Eq. ( |12[ ) becomes exact for 
a Gaussian posterior distribution. The FoMs for various 
scenarios in the WQ-w a plane are given in Table |III| We 
find that including the systematic errors reduces the FoM 
by about a factor of two to three. 



FoM (»0»a) 


j-^stat 


C full 


SN 


2.28 


1.16 


SN+BAO+CMB 


32.9 


11.8 



TABLE III. Values of the DETF FoM for SN alone (middle 
row) and SN+BAO+CMB (bottom row). The middle column 
shows the FoMs for the diagonal covariance matrix D stat only, 
while the right column shows the FoMs for the full covariance 
matrix C u . Note that including the systematics reduces the 
FoM by a factor of two to three. 



D. Principal Components 

We now describe the methodology of how to calcu- 
late and constrain the principal components of DE [43j , 
which are weights in redshift ordered by how well they 
are measured by a given cosmological probe and with a 
given survey. 

Following e.g. Mortonson et al. [14] . we first precom- 
pute the PCs assuming the current data centered at a 
fixed fiducial model (we choose the standard flat ACDM 
model with Hm = 1 — SI a = 0.25). We follow the pro- 
cedure set forth by the Figure of Merit Science Working 
Group (FoMSWG) [UJ and parametrize w{z) by 36 piece- 
wise constant values in bins uniformly spaced in scale 
factor a in the range 0.1 < a < 1.0. We fix (i.e. ignore) 
all other parameters in the FoMSWG except for and 
the SN la nuisance parameter^ A4 because they are not 
probed by the SN la data, and at the same time they 
are effectively marginalized over in the BAO and CMB 
data in the distilled observable quantities, A(z) and R 
respectively, that we use. We fix curvature to zero. 



3 In the Fisher matrix precomputation of the PCs we assume a sin- 
gle M parameter as per usual practice (and following the FoM- 
SWG parametrization), but in the actual constraints on the cos- 
mological parameters we adopt two such parameters as described 
in Sec. |II A| To the extent that the PCs will be correlated any- 
way due to the differences between real data and assumed "data" 
going into the Fisher matrix, this subtle difference will be unim- 
portant. 



7 




FIG. 6. 68.3%, 95.4%, and 99.7% likelihood constraints on wo and w a in a flat universe, marginalized over fl« and the nuisance 
parameters. The left panel shows SN-only constraints, while the right panel shows combined SN+BAO+CMB constraints. The 
shaded blue contours represent constraints with only statistical SN errors assumed (D stat ), while the red contours represent the 
full systematic SN covariance matrix (C u ). Note that the ACDM model (wo, w a ) — (— 1, 0), represented by the black dashed 
lines, is fully consistent with the data. 



We therefore have a 38 x 38 Fisher matrix (or really 
a 45 x 45 Fisher matrix with seven parameters fixed), 
corresponding to parameters 

Pi e {wi,...,w 36 ,tt M ,M}. (13) 

We marginalize over Q,m and M. and then diagonalize 
the remaining 36-dimensional Fisher matrix of the piece- 
wise constant w parameters. The resulting eigenvectors 
- shapes that describe w(z) - are the PCs ei(z), and we 
show the 10 best-determined of these PCs, ei(z)-e\o(z), 
in Fig. [7} 

The equation of state can be described as [48] 

N 

l + w{z) = ^2a l e l {z), (14) 
i=i 

where a, are amplitudes for each PC e^(z). While the 
Fisher matrix tells us the best accuracy to which these 
PCs are measured using the assumed data set (these ac- 
curacies are related to the eigenvalues Xi via a(ai) — 

— 1/2 

), we are not interested in this; rather, we would 
like to constrain the PCs using actual current data. 

We then feed the shapes in redshift of the first several 
PCs to the MCMC procedure to constrain these (and a 
few other, non-w(z)) parameters. 

Finally, in our parameter search we impose weak priors 
on the PCs. Following [48] we impose a hard-bound prior 



on each on, enforcing its contribution to excursions in 
the equation of state to the region |1 + w(z)\ < 1. This 
approach yields top-hat priors of width [15] 

JV,,pc 

A« ; = ^ £ |eite)l (15) 

centered at w(z) = —1 or ctj = 0. As we will demon- 
strate, these priors are much wider than the allowed 
ranges for most of the individual PCs, meaning that our 
principal results are largely unaffected by the prior (In- 
deed, we verified this explicitly by constraining the PCs 
without the prior). 

The pairwise constraints on all 13 parameters (£Im, the 
PC amplitudes a.\ — o>io, and the nuisance parameters a s 
and f3 c ) are shown in Fig. [8] The black curves represent 
constraints from the diagonal statistical SN errors only, 
while the red curves correspond to the full SN covariance 
matrix. Overall, the systematic errors broaden and shift 
the contours slightly. 

In Fig. H we show the individual marginalized con- 
straints on the 10 PC amplitudes. We are extremely en- 
couraged by the fact that constraints on more than five of 
the lowest PCs are very good even with current data, a re- 
sult incidentally also found by [14] using a slightly differ- 
ent combined "current" data set that, most notably, did 
not include the BOSS and WiggleZ BAO measurements. 
Here we again see that the SN systematics broaden the 
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FIG. 7. The first 10 PCs, ei(z)-eio(z), used in our analysis, 
in order of increasing variance (bottom to top). The PCs 
were obtained assuming the observable quantities centered at 
the fiducial ACDM model, but with actual errors from the 
current data. See text for details. 



constraints slightly; however, as we show just below, the 
cumulative effect of the systematics on the FoM is not 
negligible. 

We finally calculate the generalization of the DETF 
FoM to PCs. As denned in Mortonson et al. f!5l . 



FoMi PC ) 



det C r . 



detC 



(prior) 



-1/2 



(16) 



where C n is the nxn covariance submatrix of n PCs and 



det C^ ior) = Yl 



is the determinant of the top-hat prior covariance on the 
n PC coefficients. Each (Aai/\/l2) 2 term refers to the 
RMS value of the top-hat prior, where Aa^ is the width 
of the top- hat prior as calculated in Eq. (151. 



FoM results are shown in Fig. 10 where we show the 
FoM as a function of the number of PCs included. The 
top panel shows the FoMs with and without SN sys- 
tematic errors, while the bottom panel shows the cor- 
responding ratios of the two cases. We see that the FoM 
degradation with the addition of SN systematic errors 
asymptotes to about a factor of two when only two PCs 
are included and after that remains relatively constant. 



We therefore conclude that only the lowest two PCs are 
affected by current systematic errors. We suspect that 
this is due to the fact that the effect of the systematics 
is smooth in redshift, and therefore systematics do not 
become degenerate with the higher PCs that wiggle in z 
(see the PC shapes in Fig. [7]). It is somewhat fortuitous 
that higher (n > 2) PCs seem to be unaffected by sys- 
tematics, since it is precisely those higher PCs that are 
difficult to measure accurately; however, it may be the 
case that systematics in future data will behave differ- 
ently and affect the higher components. 



IV. EFFECT OF FINITE DETECTION 
SIGNIFICANCE OF BAO 

In an interesting paper, Bassett and Afshordi [25] 
pointed out that for marginal detections of cosmologi- 
cal observable quantities, a Gaussian assumption for the 
likelihood may be a poor one, especially for models that 
are several-a away from the central value of the observed 
quantity. This happens because the usual Gaussian likeli- 
hood implicitly ignores the possibility that the observed 
quantity has not actually been detected in the data at 
all. That possibility may have non-negligible probability, 
and in that case a flat likelihood in the observable may 
be more appropriate. In other words, writing a total like- 
lihood of parameters p as a function of data vector d, we 
have 

P(p|d) = Pdetcct P(p|d, detect) (17) 

+ (1 - Pdetcct) P(p|d, noise) 

where -Pdetcct is the probability that the obsevable quan- 
tity has actually been detected and P(p|d, detect) is the 
likelihood of the cosmological parameters in that case. 
The cosmological parameter likelihood P(p|d, noise) cor- 
responds to the case that the observable feature was ac- 
tually noise, and it can be represented by a flat distribu- 
tion in the parameters p. Most BAO analyses effectively 
assume that Pdetect = 1> thus ignoring the higher-than- 
expected tail in the overall likelihood coming from the 
nonzero second term on the right-hand side of Eq. (17 1. 



If the BAO feature has been detected at very high sig- 
nificance then this is a good assumption, but it is not a 
priori clear that this is the case with all of the current 
BAO surveys which typically have several-cr detection 
significances. 

To account for the diminished power of the observa- 
tions to discriminate between cosmological models when 
detection significance is not high, Bassett and Afshordi 
[15] suggest a fitting function which replaces the usual 
Gaussian % 2 expression Axg with 



Ax 2 = 



Ax 2 ; 




(18) 



Ax 4 



G 
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FIG. 8. 68.3%, 95.4%, and 99.7% likelihood contours for all pairwise combinations of the 13 cosmological parameters. Diagonal 
boxes show the 1-D marginalized likelihood for each parameter. The black contours illustrate the case of diagonal statistical 
SN errors only (D stat ), while the red contours include the full systematic SN covariance matrix (C fu11 ). The parameter ordering 
is (top to bottom, or left to right): matter density relative to critical fijf , the 10 PC amplitudes ai— Qio, and the stretch and 
color nuisance parameters a s and j3 c . Note the good constraints on all parameters except for the last few PC amplitudes. 



where S /N is the signal-to-noise ratio or detection signif- 
icance of the observable feature or quantity. With this 
prescription, the quantity A\ 2 is equal to its Gaussian 
counterpart for departures from the best-fit model that 
are small compared to the signal-to-noise of the observed 



feature, but it asymptotes to a constant "tail" (S/N) 2 in 
the opposite limit, when Ax% > (S/N) 2 . 

Here we apply this reasoning to the measurement of 
the BAO feature. The significances of the detection of 
the BAO feature are 2.4<r (corresponding to S/N = 2.4) 



10 




FIG. 9. Marginalized SN+BAO+CMB constraints on the 10 PC amplitudes. The dashed vertical lines represent the prior 
limits. Black curves represent constraints from the diagonal statistical SN errors only, while red curves correspond to the full 
SN covariance matrix. Note the good constraints on all PC amplitudes except for the last few. 



for 6dF [27], 2.8a for WiggleZ [30] (combined for three 
rcdshift bins), 3.6a for SDSS [35] (combined for two red- 
shift bins), and 5. Oct for BOSS [35]. We expect that, once 
the probability of non-detection of the BAO feature has 
been included, the BAO constraints will change, espe- 
cially for surveys with lower significance of detection and 
for 99.7% contour regions. This has in fact been con- 
firmed by Bassett and Afshordi [ffi] for the case of the 
SDSS BAO data alone. 

shows the effects on the BAO-only (left panel) 



Fig. 11 



and BAO+CMB+SN (right panel) constraints in the 
VLm~w plane with and without the finite detection of the 
BAO features taken into account^] Note that the differ- 
ences are modest in the BAO-only case and negligible in 
the combined case. This is as expected, especially given 
that some of the strongest BAO data sets (e.g. BOSS) 
also have the highest detection significances of the BAO 
feature. 

Note also that there is nothing BAO-specific to the ef- 
fects of the finite detection significance. While the CMB 
is detected with very high confidence and thus does not 
warrant a similar analysis, it could be applied to SNe 
la where, for example, a few percent of SNe may not 
be Type Given the full probabilistic classification of 
each SN on whether or not it is Type la [SO] [ST], one could 



carry out a similar analysis, which in this context would 
be how imperfect purity of the SN la sample affects the 
constraints on cosmological parameters. We suspect the 
results would be even less discrepant relative to the usual 
perfect-detection analysis than in the case of BAO, and 
we do not pursue such an analysis in this paper. 

In conclusion, the finite detection significance of the 
BAO feature in large-scale structure surveys leads to a 
small but discernible weakening of the constraints on cos- 
mological parameters. 



V. CONCLUSIONS 

In this paper, we have investigated the effects of sys- 
tematic errors in current SN la observations on DE pa- 
rameter constraints. We accounted for the systematic er- 
rors in SN la observations, including the effects of photo- 
metric calibration, dust, color, gravitational lensing, and 
other systematics by adopting a fully off-diagonal covari- 
ance matrix between ~ 500 SNe from the SNLS compila- 
tion (see Fig. [2| . We extended the similar analysis from 
Conley et al. [o] by constraining the temporal evolution 
of the equation of state of DE described by the pair of 
parameters (w , w a ) as well as a much richer description 
in terms of 10 PCs of the equation of state (shown in 



4 The results in the WQ-w a plane are qualitatively similar, and we 
do not show them here. 

5 Conley et al. [5] find that the fraction of non-la SNe rises from is very conservative, and the true fraction of non-la SNe is likely 
zero at low redshift to O(10%) at z ~ 1; however, their modeling very small in the current data sets. 
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FIG. 10. Top panel: FoM as a function of the number of PCs 
included, with the black line showing the statistical-only FoM 
and the red line showing the FoM with systematics included 
(See Eq. (16 1 for the definition of the FoM). Bottom panel: 



ratio of the FoM with systematic errors considered in the SN 
la data to that with only statistical errors considered. BAO 
and CMB constraints were included in both cases. Notice 
that the FoM ratio levels off after approximately two PCs 
have been added to the analysis. 



are affected by the systematics, but the overall con- 
straints are still strong even after their inclusion (see 
Figs. [3] and [6]). More importantly, we found that system- 
atic errors affect the contraints somewhat, reducing the 
DETF FoM by a factor of about three (see Table [I!!]), 
while the generalized PC-based FoM is degraded by a 
factor of two (see Fig. |l0|). However, as the PC analysis 
shows, this degradation is mainly restricted to the first 
two numbers (PC amplitudes) describing DE. In fact, 
what is particularly impressive about current data is that 
more than five PCs are well-constrained even in the pres- 
ence of systematic errors (see Figs. [8] and [9J. 

In the spirit of testing for systematic effects in current 
data constraining DE, we also wondered if the relatively 
low detection significances of BAO features, ranging from 
about 2.4-cr to 5.0-cr in various surveys, change the over- 
all cosmological constraints. While not a systematic er- 
ror per se, a small but non-negligible probability that the 
BAO feature has not been detected in some of these sur- 
veys implies that the posterior probability of cosmologi- 
cal parameter values asymptotes to a small but nonzero 
value far from the likelihood peak [53] • We find that, 
while the BAO-only constraints are somewhat affected, 



the combined constraints are not (see Fig. 11) 



From all this, we conclude that current systematic er- 
rors do degrade DE constraints and FoMs, but not in a 
major way. Given that future constraints are forecasted 
to be much better, continued control of current system- 
atic errors remains key for progress in characterizing DE. 
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